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ABSTRACT 

This  paper  presents  the  results  of  a  2012  life  cycle  cost  (LCC)  study  of  hybrid  Reusable  Booster 
Systems  (RBS)  conducted  by  NASA  Kennedy  Space  Center  (KSC)  and  the  Air  Force  Research 
Laboratory  (AFRL).  The  work  included  the  creation  of  a  new  cost  estimating  model  and  an  LCC  analysis, 
building  on  past  work  where  applicable,  but  emphasizing  the  integration  of  new  approaches  in  life  cycle 
cost  estimation.  Specifically,  the  inclusion  of  industry  processes/practices  and  indirect  costs  were  a  new 
and  significant  part  of  the  analysis.  The  focus  of  LCC  estimation  has  traditionally  been  from  the 
perspective  of  technology,  design  characteristics,  and  related  factors  such  as  reliability.  Technology  has 
informed  the  cost  related  support  to  decision  makers  interested  in  risk  and  budget  insight.  This  traditional 
emphasis  on  technology  occurs  even  though  it  is  well  established  that  complex  aerospace  systems  costs 
are  mostly  about  indirect  costs,  with  likely  only  partial  influence  in  these  indirect  costs  being  due  to  the 
more  visible  technology  products.  Organizational  considerations,  processes/practices,  and  indirect  costs 
are  traditionally  derived  (“wrapped”)  only  by  relationship  to  tangible  product  characteristics.  This 
traditional  approach  works  well  as  long  as  it  is  understood  that  no  significant  changes,  and  by  relation  no 
significant  improvements,  are  being  pursued  in  the  area  of  either  the  government  acquisition  or  industry’s 
indirect  costs.  In  this  sense  then,  most  launch  systems  cost  models  ignore  most  costs.  The  alternative 
was  implemented  in  this  LCC  study,  whereby  the  approach  considered  technology  and  process/practices 
in  balance,  with  as  much  detail  for  one  as  the  other.  This  RBS  LCC  study  has  avoided  point-designs,  for 
now,  instead  emphasizing  exploring  the  trade-space  of  potential  technology  advances  joined  with 
potential  process/practice  advances.  Given  the  range  of  decisions,  and  all  their  combinations,  it  was 
necessary  to  create  a  model  of  the  original  model  and  use  genetic  algorithms  to  explore  results.  A  strong 
business  case  occurs  when  viable  paths  are  identified  for  an  affordable  up-front  investment,  and  these 
paths  can  credibly  achieve  affordable,  responsive  operations,  characterized  by  smaller  direct  touch  labor 
efforts  at  the  wing  level  from  flight  to  flight.  The  results  supporting  this  approach,  its  potential,  and  its 
conclusions  are  presented  here. 


INTRODUCTION 

Beginning  in  mid-2011,  NASA  Kennedy  Space  Center  began  anew  it’s  collaboration  with  the  US 
Air  Force  Research  Laboratory  (AFRL).  Collaborative  work  in  201 1  explored  the  possibility  that  a  life 
cycle  cost  methodology  could  deviate  from  the  traditional  product  or  “what”  centered  view  into  “how”.  This 
early  exploratory  work  showed  how  (1)  design/technology,  (2)  reliability  and  (3)  organizational  processes 
and  practices  could  be  organized  as  drivers,  or  inputs  when  considering  life  cycle  outcomes  such  as  near 
term  costs,  far  term  costs,  and  responsiveness  (flight  rate  capability). 

In  2012  a  task  was  formally  begun  carrying  the  exploratory  work  further  into  a  life  cycle  cost  study 
of  a  hybrid  reusable  booster  system.  This  would  include  developing  a  new  life  cycle  cost  model  and 
performing  analysis  to  assist  in  understanding  the  business  case  for  an  RBS.  This  work  is  described  here. 

OBJECTIVE 

Cost  models  of  large  scale  projects  can  serve  an  assortment  of  purposes  within  an  organization. 
Government  projects  will  use  cost  models  in  support  of  2life  cycle  management,  budgeting  processes, 
changes  in  course,  or  to  simply  quantify  and  understand  past  experience  before  going  down  some  path. 

A  cost  model  can  place  an  emphasis  on  the  product  at  hand,  past  data  or  analogies,  prediction,  budget 
adequacy,  confidence  in  cost  and/or  schedule,  and  so  on  with  an  emphasis  on  one  factor  often  meaning 
less  usefulness  on  others. 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

2q  J2  2-  REpORT  TYpE 

3.  DATES  COVERED 

00-00-2012  to  00-00-2012 

4.  TITLE  AND  SUBTITLE 

New  Approaches  In  Usable  Booster  System  Life  Cycle  Cost  Modeling 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

National  Aeronautics  and  Space  Administration, Kennedy  Space 

Center ,FL,  32899 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS (ES) 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

14.  ABSTRACT 

15.  SUBJECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF:  17.  LIMITATION  OF 

ARSTRATT 

1 8 .  NUMBER  1 9a.  NAME  OF 

OF  PAGES  RESPONSIBLE  PERSON 

a.  REPORT  b.  ABSTRACT  c.  THIS  PAGE  Same  aS 

unclassified  unclassified  unclassified  Report  (SAR) 

13 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


For  our  RBS  case,  the  cost  model  objectives  that  would  be  emphasized  are  (1)  the  business 
case,  (2)  it’s  actionable  characteristics,  and  (3)  examining  data  within  the  context  of  “how”  (processes, 
practices)  as  well  as  “what”  (the  product). 

•  Assist  in  maturing  the  business  case  for  the  development  and  operation  of  a  responsive  and 
affordable,  Air  Force  Reusable  Booster  System  (RBS). 

•  Emphasize  tangible,  actionable  characteristics  of  the  whole  system,  design/technology  and 
organization/industry  processes/practices,  to  inform  a  potential  programs  definition  and  direction. 

•  Examine  historical  data  within  the  context  of  “how”  (processes,  practices)  as  well  as  “what”  (the 
product). 


PRELIMINARY  RESULTS,  SUMMARY  BUSINESS  CASE  FOR  AN  RBS 

The  study  described  herein  shows  what  appear  to  be  abundant  options  along  dual  paths  that 
would  justify  a  decision  to  proceed  or  formulate  a  Reusable  Booster  System  program.  One  path  will  be 
called  the  path  of  “Effectiveness”,  the  other  “Effectiveness  and  Efficiency”. 

In  the  paradigm  of  effectiveness,  the  main  question  going  in  is  the  need  to  identify  investments 
such  that  a  relatively  small  change  in  these  results  in  a  very  large  change  in  outcomes.  Outcomes  of 
special  interest  in  this  paradigm  are  about  responsiveness,  being  mission  capable,  readiness  and  war¬ 
fighting  potential.  If  a  relatively  small  change  in  the  envisioned  investment,  from  focusing  on  the  right 
design,  technology  or  “-ilities”  can  result  in  an  operating  wing  50%  smaller  than  that  for  a  design  lacking 
these  investments,  then  the  business  case  is  strengthened. 

Further,  on  sheer  quantity,  if  many  combinations  of  these  design/technology  options  can  be 
identified  the  case  is  strengthened  that  such  an  investment  path  is  not  overly  constrained,  having  to  be 
exactly  of  a  sort.  It  is  only  necessary  to  have  enough  of  the  right  choices  moving  in  the  right  direction,  not 
some  singular  combination.  The  stakeholders  interested  in  this  view  would  include  technology  managers, 
their  technologists,  and  decision  makers  in  general  that  oversee  early  research  and  development. 

Alternately,  in  the  paradigm  of  effectiveness  and  efficiency,  the  main  question  is  about  how  to 
justify  turning  investments  into  a  real  program,  justified  on  predicted  benefits  and  outcomes,  under 
circumstances  where  the  absolute  amounts  invested  (or  available)  are  also  reduced.  The  relative  amount 
of  additional  investment  that  would  result  in  a  more  responsive  or  operable  system  is  a  moot  point  in  this 
paradigm,  as  even  the  baseline  investment  is  taken  to  be  unacceptable.  A  small  addition  to  the  up-front 
investment  is  a  small  addition  atop  an  impossible  starting  point. 

The  paradigm  of  effectiveness  and  efficiency  identifies  many  combinations  of  factors,  beyond  the 
design/technology  of  the  product,  delving  into  the  processes  and  practices  of  the  performing 
organizations  (industry).  Once  again,  on  sheer  quantity,  many  combinations  of  industry  process/practice 
factors  have  been  identified,  supporting  the  notion  that  such  a  program  path  would  not  be  overly 
constrained,  having  to  execute  the  program  exactly  to  a  rule.  It  is  only  necessary  to  be  in  the  general  area 
of  design/technology  and  industry  process/practice  characteristics  that  are  in  the  realm  of  low  up-front 
costs,  low  operations  and  production  costs,  but  high  capability. 

APPROACH  AND  SYSTEM  SCOPE 

The  hybrid  RBS  chosen  for  this  study  is  in  the  15,000lbm  (LEO  28.7deg,  lOOnm)  payload  class. 
Given  the  exploratory  nature  of  the  task,  an  initial  single  design  point  was  avoided.  In  many  an  exercise  of 
this  nature,  a  chosen  architecture  is  defined  to  some  appropriate  level  of  fidelity  (how  many  engines,  what 
type  power  supply,  the  power  systems  weight,  etc.)  More  design  iterations  would  begin  serially  after  some 
initial  foray  was  made  into  that  initial  design  by  the  assorted  analysis  disciplines.  In  this  approach  the 
initial  single  point  design  would  not  only  be  avoided,  it  would  not  even  be  an  output. 
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Figure  1 :  The  RBS  System/Study  Scope 


Although  the  approach  described  previously  would  avoid  an  initial  single  point  design,  it  was  still 
necessary  to  define  the  system  (and  by  relation  the  studies)  scope.  The  system/study  scope  is  outlined  in 
Figure  1.  Though  not  100%  comprehensive  at  this  time  (measured  in  reference  to  3Mil-Standards),  and 
not  all  of  the  areas  received  the  same  level  of  detailed  treatment,  the  scope  addresses  most  of  the  areas 
of  discussion  that  arise  at  this  stage  of  study  and  analysis,  and  then  some,  based  on  the  analysts 
experience.  (Future  study  may  delve  further  into  areas  that  received  less  detail,  enter  into  areas  not 
addressed,  or  both,  according  to  the  resources  available). 

RECONN AISANCE  -  THE  BASIS  OF  ESTIMATE 

The  basis  of  estimate  of  any  model  for  a  large  scale  aerospace  project  must  begin  with  the 
accumulation  of  cost  data  and  a  review  and  understanding  of  the  meaning  of  that  data.  Of  particular 
interest  to  the  objectives  of  this  analysis  were  providing  an  actionable  understanding,  with  as  much 
focus  on  data  within  the  context  of  “how”  (processes,  practices)  as  well  as  “what”  (the  product). 

By  policy,  indirectly,  a  government  acquisition  emphasizes  “what”,  the  product,  the  item,  the 
tangible  purchase,  acquired  deliverable  or  service.  There  are  good  and  ample  reasons  for  this  emphasis 
given  extremely  complex  systems  and  the  numerous  organizations  involved  in  both  government  and 
industry  aerospace.  The  Mil-Standard  on  Work  Breakdown  Structures  (WBS)  points  out  how  “generating 
and  applying  uniform  work  breakdown  structures  improves  communication  in  the  acquisition  process”. 

Clearly  everyone  in  government  or  industry  involved  in  the  process  of  getting  Product  X  from  idea 
to  reality  should  always  be  on  the  same  understanding  of  “what”  they  mean  when  they  talk  about  Product 
X.  Nonetheless,  this  formal  acquisition  policy  emphasis  on  “what”  can  turn  attention  away  from  “how”  an 
industrial  partner  turns  an  idea  into  reality.  An  acquiring  government  organization  (technical  or  non¬ 
technical)  may  be  loath  to  delve  into  “how”  when  outcomes  have  been  so  procedurally  linked  to  “what”. 
This  creates  a  dilemma-as  the  cost  data  of  projects  that  are  ever  more  complex  shows  more  and  more 
convincingly  that  desired  project  outcomes  such  as  affordability,  or  responsiveness,  up-front  or  once 
operational,  outcomes  on  a  par  with  the  product,  are  by  necessity  about  “how”. 

As  early  as  1990  it  was  observed  by  4,5McCullough  and  Balut,  reviewing  aircraft  projects,  and 
industry  (contractor)  costs  that  - 


“Overhead  costs  were  neither  visible  nor  understood,  so  common  practice  was  to  use  poorly 
documented  (sometimes  proprietary)  factors  to  "burden"  the  labor  estimates.  The  practice  has 
persisted,  even  though  direct  manufacturing  labor  has  nearly  disappeared  as  a  cost  driver,  and 
overhead  has  grown  to  represent  more  than  half  the  cost  of  defense  systems,  and  may  rise  to 
represent  two-thirds  of  these  costs.  ” 

“Experience  at  these  firms  indicates  that  overhead  had  grown  from  about  38  percent  of  total 
business  in  1973  to  about  49  percent  by  1987.  Extrapolation  of  this  trend  indicates  that  overhead 
will  reach  about  54  percent  by  the  year  2000.  ” 

More  recently,  most  of  the  84  recommendations  in  the  EELV  should-cost  review  were  associated 
with  overhead  and  indirect  costs. 


For  the  RBS  system,  an  immediate  natural  analogy  was  to  the  similarly  semi-reusable  Space 
Shuttle.  As  a  program  that  KSC  modelers  and  cost  analyst  were  intimately  familiar  with  -  the  data 
confirmed  program  wide  what  was  already  suspected  -  that  the  cost  of  the  effort  “close-in”,  the  nearer  to 
the  product  (the  vehicle  turnaround,  the  production,  the  materials,  etc.)  was  the  smallest  part  of  total 
expenses. 

Other  data  review  included  the  EELV  program,  United  Launch  Alliance,  the  B-2  Stealth  Bomber, 
and  the  Space-X  Falcon. 

These  previous  terms  of  costs,  making  up  most  of  the  total  costs  in  our  industry,  have  come  to  be 
referred  to  with  assorted,  often  inconsistent  naming  -  indirect,  overhead,  non-touch,  systems  engineering, 
project,  program  management,  etc.  A  WBS  that  is  not  entirely  system  and  sub-system  oriented  was 
defined,  shown  in  Figure  2,  to  clarify  terminology,  alongside  an  example  of  $10  using  historical  splits. 
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Government  /  Acquisition  Effort  (Responsible  Organization,  by  applicable  concept,  Oversight  or  Insight,  by  phase,  R&D,  DDT&E,  Ops  and  Support, 
Production,  etc.) 

•  Program  view 

•  Program  Management  (aka  "SPO")  :  Government,  Civil  Servants,  Blue  Suiters  and  Support  Contractors 

•  Leadership/Management 

•  Systems  Engineering  and  Element  Integration 

•  Technical  Management,  Financial,  Budgeting,  etc. 

•  -i-Overhead,  etc.  (May  or  may  not  be  included  in  cost  estimates.  Re.  GR&A.  Captures  generic  facilities,  l/T,  human  resources,  payroll,  and  other 
administrative  and  business  costs.) 

•  Project  view 

•  Project  Management:  Government,  Civil  Servants,  Blue  Suiters  and  Support  Contractors 

•  Management 

•  Element  Engineering  and  Sub-systems  Integration 

•  Technical  Management,  Financial,  Budgeting,  Procurement,  etc. 

•  -i-Overhead,  etc.  (May  or  may  not  be  included  in  cost  estimates.  Re.  GR&A.  Captures  generic  facilities,  l/T,  human  resources,  payroll,  and  other 
administrative  and  business  costs.) 

Industry  Effort  (Performing  Organization,  by  applicable  concept  /contract  approach,  by  phase,  R&D,  DDT&E,  Ops  and  Support,  Production,  etc.) 

•  Product  view 

•  DIRECT  (Design/technology) 

•  MAKE:  Technicians,  Shop  Floor  Tasks  and  Personnel,  Unique  Facilities,  Material  and  Equipment,  Tooling,  Production,  Integration,  Assembly 
and/or  Operation. 

•  Processes/practices  view 

•  INDIRECT -Support 

•  MAKE:  Engineering,  including  Systems  Engineering  and  Integration,  Safety,  Quality,  Technical  Management,  Design,  Changes  in  Design, 
Document  Creation  (Drawings,  Instructions,  etc.) 

INDIRECT  -  Business  Functions 

•  PLAN:  Requirements  management  and  flow-down,  program  /  project  interfaces  /  coordination,  rules  management,  configuration 
management,  documentation,  authorization,  tracking  and  scheduling  (PLAN  the  SOURCING,  MAKING,  etc.) 

•  SOURCE:  Acquisition,  purchase,  sub-contracts,  supplier  management,  verification  of  product,  make  or  engineer,  etc. 

•  DELIVER:  The  logistics,  validation,  delivery  scheduling,  planning/interfaces,  etc. 

•  RETURN:  Reverse  of  Deliver  and  Source  functions,  identifying  anomalies,  defects,  conditions,  disposition,  etc. 

•  -i-Overhead,  etc.  (Always  included  in  cost  estimates,  as  this  is  built  into  industry  pricing.  Captures  generic  facilities,  l/T,  human  resources, 
payroll,  and  other  administrative  and  business  costs.) 


Figure  2:  Basis  of  Estimate  -  Work  Breakdown  Structure,  Detail 


THE  RBS  MODEL 


The  1 .0  RBS  model  would  rely  on  past  modeling  and  analytical  expertise.  Other  models 
developed  by  KSC  in  support  of  past  programs  such  as  the  6LLEGO  model,  contributed  greatly,  with  most 
of  the  cost  estimating  relationships  consistent  with  decision  analysis  and  problem  decomposition 
techniques.  As  has  been  observed  before  when  attempting  to  connect  causes  to  outcomes  - 

“...the  cognitively  demanding  task  of  information  combination  can  be  performed  by  model, 
typically  implemented  on  a  computer.  Furthermore,  the  framework  is  general  enough  to 
incorporate  information  from  diverse  sources,  including  both  'hard'  data  and  'soft'  subjective 
assessments.  ”  (7Kleinmuntz) 


The  first  task  was  to  break  out  product  from  processes/practices.  Shown  in  Figure  3  is  the 
product  input  screen  (1  of  7)  for  describing  the  technology  or  design  (including  where  emphasized,  the 
reliability)  of  the  RBS. 


The  RBS  LCC  Model  -  Sample  Screen 


Product  Inputs 


(7  Screens,  TPS  example) 

Most  model  inputs  represent  a  level  of 
detail  that  is  pre-PDR,  high  level. 

•  Some  inputs  may  require  more 
fidelity  in  system  definition. 

•  TPS 

•  Propulsion  (Main  +  Other) 

•  Fluids  and  Gases 

•  Power,  Avionics  and  Health 
Management 

•  Structures 

•  Other 


Sample  screen  for  illustrative  purposes  only. 
Specific  values  shown  do  not  represent  specific  analysis. 


2  outputs  graphs  calculate  on  any  change;  immediate  user  feedback. 


Figure  3:  Product  View  of  the  RBS  LCC  Model 

The  second  task  was,  similarly,  to  breakout  the  view  of  “how”  the  product  is  implemented,  as 
shown  in  Figure  4.  In  each  case  about  as  many  variables,  or  questions  (inputs)  as  a  surrogate  for 
measuring  a  level  of  detail,  were  developed  for  describing  the  vehicle,  system  or  thing  (what)  as  were 
developed  for  “how”  the  product  was  to  be  achieved  (developed,  produced,  operated). 

This  is  a  novelty  in  this  RBS  LCC  model,  as  a  survey  of  the  field  of  aerospace  cost  models  would 
invariably  find  - 

(1)  The  number  of  variables,  inputs  or  switches  that  could  be  categorized  as  about  “how”  would  be  an 
order  of  magnitude  fewer  than  the  count  of  inputs  that  could  be  categorized  as  related  to  “what”, 
describing  the  product.  (“How”  features  and  understanding  are  thus  part  and  parcel  of  the  “what”  data 
in  most  models,  hiding  insight  there). 


(2)  That  even  these  process/practice  switches  are  relegated  to  being  weak  switches,  or  kept  constrained 
on  their  range,  meaning  that  even  a  known  answer  may  not  be  reproducible  when  it  depends  too 
much  on  “how”.  (The  case  in  point  being  the  recent  8,9review  of  the  “NAFCOM”  model  when 
considering  a  Space-X  Falcon  9  development). 

(3)  That  many  “how”  variables  in  cost  models,  being  for  government  decision  makers,  or  the  government 
acquisition,  focus  on  the  program/project  management,  and  the  acquisition  approach  -  not  industry, 
where  most  of  the  money  will  be  spent. 


The  RBS  LCC  Model  -  Sample  Screen 

•  Processes/Practices  Inputs  — 

(7  Screens,  Production  example) 

Analysts  must  select  inputs  descriptive 
of  the  expected  capability  of  the 
performing  organization: 


"Best  practices"  follow  a  plan, 
source,  make,  deliver,  return 
pattern. 

"Agile  R&D"  and  "Agile  Product 
Development",  lead  to  "Lean 
Manufacturing/Production"  and 
Advanced  Supply  Chain 
Management,  segueing  into 
similarly  efficient  operations. 


Sample  screen  for  illustrative  purposes  only. 
Specific  values  shown  do  not  represent  specific  analysis. 


Area  of  the  model  most  likely  to  evolve  significantly  in  immediate  Forward  Work  -  esp. 
the  graphic  user  interface,  and  the  visibility  of  input  linkages  specifically  to  either  early 
R&D,  product  development,  manufacturing/production,  or  operations. 


Figure  4:  Processes/Practices  View  of  the  RBS  Model 


Given  the  number  of  variables  involved,  it  became  necessary  as  happens  with  complex  models  to 
find  a  way  to  actually  perform  a  useful,  repeatable,  quantity  and  quality  of  analysis,  searching  throughout 
the  design  space  for  those  “aha”  moments.  For  this  task  it  is  now  possible  to  employ  off-the-shelf  tools 
such  as  Phoenix  Integration  ModelCenter  (rather  than  automating  or  adding  features  to  the  analysis 
capability  at  the  MS  Excel  level).  Automation  is  thus  used  to  create  analysis  products  that  an  analyst 
could  not  conceivably  do  manually  in  any  reasonable  amount  of  time.  (Some  of  the  analysis  runs 
described  ahead  would  take  a  typical  laptop  a  few  hours  -  each). 


RESULTS  AND  DISCUSSION  -  EFFECTIVENESS  VIEW 


Shown  in  Figure  5  is  an  example  run  (using  genetic  algorithms)  where  some  output  of  up-front 
cost  is  plotted  against  some  output  of  far  term  cost  (or  ~  benefit).  (Note  that  inputs  are  specific  to  and 
contained  inside  each  point  in  the  scatter,  and  are  not  on  the  axes).  There  are  various  dilemmas  with  the 
design  space  explored  if  the  purpose  is  to  proceed  into  a  program  using  some  form  of  this  in  a  business 
case.  Although  a  (relatively)  small  amount  of  increase  in  the  up-front  cost  (Y-axis),  coupled  with  the  right 
investment  directions  for  operability,  can  buy  a  significant  improvement  in  responsiveness,  the  actual  total 
up-front  amount  may  be  funding  that  is  simply  not  tenable  (appealing,  justifiable,  etc.)  Alternately  the  view 
is  invaluable  if  the  program  is  a  technology  program,  wanting  insights  into  investment  directions.  Each 
point  in  the  scatter  plot  contains  the  numerous  technology  choices/inputs  or  “genes”  for  a  design  the 
output  of  which  are  the  costs  on  X  and  Y. 


*  Multi-Objective  Genetic  Algorithm  Optimization 

*  Seeking  Options  Improving  Responsiveness  through  Design/Technology 

A.  NOT  a  co-relation 

•  Traditional  optimization  of  product 
design/technology  inputs  only  (which 
yield  X  &  Y)  reveals  the  typical  decision 
makers  dilemma  -  pay  now  or  pay  later. 


•  Pro's  -  Identifies  tactical,  specific  areas 
for  best  value  R&D,  design  and 
technology  investment . 

•  Identified  $  spent  per  O&S  saved. 

•  Reduced  per  flow  O&S  direct  means 
greater  responsiveness. 

•  More  launches  possible  by  scaling 
up  an  affordable  per  flow  operation. 

•  Con's  -  Understanding  these  relationships  lends  only  partial  insight  into  an  acquisition  path 
seeking  significant  gains  in  responsiveness  and  up-front  affordability. 


Figure  5:  Traditional  Optimization  of  Design/Technology  (Only)  vs.  Costs  Near  and  Far 

Some  caveats  about  the  prior  analysis  results  - 

(1)  These  results  do  not  integrate  risk,  confidence  or  related  uncertainties  (in  the  data,  or  cost  estimating 
relationships).  This  will  be  considered  in  forward  work. 

(2)  In  lieu  of  a  time  specific  analysis  and  set  of  variables  (such  as  an  integral  discrete  event  simulation,  or 
some  type  of  joint  cost  and  schedule  confidence  level,  a  “JCL”)  the  responsiveness  is  considered 
improved  as  regards  model  feedback  when  the  direct,  close-in  wing  ops  workforce  requirement  (on 
the  X-axis)  is  reduced. 


RESULTS  AND  DISCUSSION  -  EFFECTIVENESS  AND  EFFICIENCY  VIEW 


Allowing  the  automated  search  of  the  design  space  to  also  alter  the  process/practice  variables, 
the  “how”  to  achieving  the  product,  will  yield  very  different  results,  shown  in  Figure  6  vs.  Figure  5.  It  is 
now  possible  to  achieve  the  responsiveness  and  the  recurring  operations  and  production  cost 
improvements  for  far  less  up-front  investment  (research,  design,  development,  test,  engineering, 
operations  and  production  development,  setup  and  acquisition,  etc.)  This  inverts  the  slope  of  the  scatter, 
as  the  genes  of  a  design  start  at  the  traditional  up-front  and  far  term  levels,  but  seek  to  explore  all  options 
that  improve  both.  (While  novel  in  the  consideration  of  complex,  large  scale  aerospace  projects,  where 
primes,  cost-plus  contracts,  protected  industries,  and  other  non-market  factors  weigh  in,  this  is  actually 
the  expected  result,  as  best  practices  evolve  this  trend  in  competitive  circumstances.) 


A- 


Multi-Objective  Genetic  Algorithm  Optimization 
*  Seeking  Options  Lowering  Both  O&S  and  Investment  $ 


NOT  a  co-relation 


Rather,  seeking  options  according  to  the 
fitness  of  meeting  certain  criteria. 

•  MINIMIZE  INVESTMENT  SUM 

AND 

•  MINIMIZE  O&S  SUM  (to  2035). 

INVERTS  the  decision  makers  dilemma, 
locating  solutions  that  best  address  the 
competing  factors  of  near  and  far  term 
costs. 

By  definition,  includes  indirect  factors, 
as  processes/practices. 
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•  Investment:  R&D  +  DDT&E  incl.  production 
capability,  flight  &  ground. 

•  O&S:  Wing  Ops  Ground  +  Production. 

•  SPO  +  PM  in  each  of  prior. 


Figure  6:  Comprehensive  Optimization  of  All  Variables  Affecting  Costs  Near  and  Far 

Interpreting  the  prior  results  - 

(1)  The  search  starts  at  a  baseline  configuration  that  is  higher  LCC  in  the  upper  right  and  eventually 
winds  its  way  down  to  the  lower  LCC  space  in  the  lower  left  (Figure  7).  That  lower  LCC  space  is 
lower  LCC  as  much  for  having  reduced  up-front  cost  as  for  having  reduced  future  costs.  The  decision 
maker’s  dilemma  of  insufficient  up-front  funding  is  thus  addressed,  pointing  the  way  to  programs  that 
can  achieve  significant  future  improvements  even  in  highly  constrained  funding  situations.  (Albeit, 
understanding  how  to  retire  one  dilemma  creates  a  new  challenge,  discussed  ahead). 

(2)  The  results  on  the  lower-end  of  the  LCC  (lower  left)  are  10consistent  with  other  studies,  but  with  more 
detail  within,  working  toward  a  more  actionable  understanding.  This  detail  could  eventually  inform 
acquisition  /  proposal  assessment,  concepts  of  operations  for  program  offices,  and  business  models 
for  acquiring  (government)  and  implementing  (industry)  organizations. 

(3)  Any  point  on  the  scatters  can  be  examined  further,  it’s  genes  (or  “data  deck”)  capturing  all  the 
necessary  information  with  which  to  explore  further.  This  is  shown  in  Figure  8.  (The  data  can  be 
loaded  back  into  the  MS  Excel  RBS  LCC  model  automatically,  further  minimizing  human  error, 
generating  graphs  (Figure  9),  for  further  analysis,  etc.) 
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Figure  7:  From  High  LCC  to  Low  LCC 


•  Example:  A  single  design  points  data  deck  from  the  prior  "seeking"  run. 


•  Ref.  BoE.  -  23  years,  through  2035.  Phasing  in  flights  starting  mid-2020's. 

•  Investment:  R&D  +  DDT&E  incl.  production  capability,  flight  &  ground. 

•  O&S:  Wing  Ops  Ground  +  Production. 

•  SPO  +  PM  in  each  of  prior. 


Figure  8:  A  Specific  Set  of  Inputs  Viewable  for  Exploring  Further 


II  RBS  R&D  &  Demonstrators  NREC 

■  US  Engine  DDT&E+Prod.  NREC 
□  US  Engine  Production  REC 

■  RB  Engine  DDT&E+Prod.  NREC 

■  RB  Engine  Set  Production  REC 

■  OperatonsWrig  Ground  (from  model  per  se)  REC 
D Special  Projects  Office  (asHICER) 

-Space  Shuttle  "what-if-contri ued"  (250klbs/year  LEO) 


■  US  Flight  System  DDT&E+Prod.  NREC 
II  US  Flight  System  Production  REC 

■  RB  Flight  System  DDT&E+Prod.  NREC 
□  RB  P reduction  REC 

■  OpsWing  Develop.  &  Act*/ ate  NREC 

■  Element  Project  Offices  (as  HI  CER) 

—  EELV  "what-if  3+3  Fits/Year”  ( 121-342klbs/y ei 


Figure  9:  The  Prior  Example  Design  Point  Loaded 
Automatically  Back  into  the  Original  RBS  LCC  MS  Excel  Model 

SUMMARY  AND  CONCLUSIONS 

It  is  possible  to  structure  aerospace  project  cost  models  in  such  a  way  as  to  avoid  the  pitfalls  of 
product  centric  views.  Product  centric  views  are  susceptible  to  being  cost  models  that  avoid  addressing 
the  cause  of  most  costs.  Process/practice  emphasis  in  causality,  where  decisions  reign,  can  be  achieved 
by  exploring  historical  cost  data  within  the  proper  context  and  using  decision  analysis  techniques  for 
establishing  relationships  at  manageable  levels  of  detail.  Automation,  the  use  of  “models  of  models”,  can 
make  these  techniques  manageable,  while  still  preserving  a  sense  of  simplicity  for  the  analyst  or 
stakeholders  receiving  the  results  of  such  analysis. 

FUTURE  WORK 

Work  in  2013  has  focused  on  collecting  and  addressing  feedback  on  the  2012  results.  As  a  result, 
current  work  includes: 

•  Especial  emphasis  on  improving  the  process/practices  section  of  the  model. 

•  Improve  the  models: 

o  User  interface. 

o  Level  of  fidelity  as  appropriate  to  the  analysis  phase,  pre-acquisition, 
o  Transparency  of  estimating  relationships, 
o  Ease  of  being  modified  by  either  the  developer  or  new  users, 
o  Usefulness  as  a  learning  tool,  independent  of  an  analyst  generating  results. 

•  Develop  “top-10”  lists  of: 

o  Prioritized  technology  specifics  and  directions 
o  Prioritized  industry  process/practice  specifics  and  directions 

•  Develop  prioritized  list  of  further  upgrades. 

The  process/practice  section  of  the  model  is  receiving  special  attention  in  2013  work.  Evolving 
towards  more  recognizable  foundations,  this  section  will  be  refined  anew  around  source  material  such  as 
the  DoD  Integrated  Product  and  Process  Development  Handbook,  the  Manufacturing  Readiness  Levels 
Deskbook,  the  Lean  Aerospace  (Advancement)  Initiative,  the  Lean  Enterprise  Model,  the  Supply  Chain 


Readiness  Levels  study,  numerous  lean  product  development  practice  compilations,  and  more.  Figure  10 
shows  the  notional  approach  to  this  part  of  the  model/methodology  upgrade. 
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DoD  Integrated  Product  &  Process  Development  (IPPD)  •  MRLDeskbook  •  Lean  Production  &  Operations  Practices  (many) 

Handbook,  Lean  Aerospace  Initiative  (LAI),  Lean  Enterprise  •  SCRL  Study  •  Supply  Chain  Operations  Reference  (SCOR) 

Model  (LEM),  ISO  15288  (and  many  more)  •  Lean  NPD  practices  (many)  Model,  Best  Practices 


Figure  10:  RBS  LCC  Model  Process/Practices  Methodology  Upgrade  in  Progress 

At  the  end  of  2013,  the  plan  is  to  distribute  the  model  across  a  broader,  external  stakeholder  community. 
Numerous  collaborative  discussions  to  that  end  have  already  begun. 
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